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Response to Amendment 

1 . The amendment received 6/27/08 has been entered in full. 

Response to Arguments 

2. Applicant's arguments filed 6/27/08 have been fully considered but they are not 
persuasive. Specifically the Applicant argues that the Nakamura reference does not 
disclose an edge enhancement part for enhancing edges of a character block classified 
previously by the block classification part, nor the generation of a threshold to then be 
used for binarizing pixels. However the Examiner does not rely on Nakamura to disclose 
these limitations but rather relies upon Barski. In response to applicant's arguments 
against the references individually, one cannot show nonobviousness by attacking 
references individually where the rejections are based on combinations of references. 
See In re Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981); In re Merck & Co., 800 
F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). 

The Applicant further argues that the Barski reference preprocesses only a 
portion of character blocks. The Examiner is not sure what the relevance of this 
statement is since regardless of what Barski preprocesses (i.e., all of the character 
blocks or a portion of the character blocks) it still reads on the limitation of the claim. 
The Applicant further argues that the mask of figure 8 of Barski is used to determine 
edge information and relies upon numerous pre-processing steps for a binarization 
threshold value. The Examiner respectfully disagrees that Barski only determines the 
edge information. As explicitly stated in col. 6 lines 63-64, the mask is for performing 
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edge enhancement. The number of pre-processing steps for the binarization threshold 
value is irrelevant to the claimed limitations. 

The Applicant further argues that it is not clear that the Barski reference 
describes the edge enhancement part for enhancing edges of the character block using 
relations between pixels in the grouped block. As can be seen in figure 8, the mask is a 
kernel which is used in in the typical convolution manner to filter an image by taking into 
account the neighboring pixel values, and furthermore this occurs prior to binarization 
step 30. 

The Applicant further argues that the edge enhancement step 28 is not solely 
relied upon for a threshold value. This argument is irrelevant to the claimed invention. 

For these reasons the rejection laid out in the previous office action is 
maintained. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1,7-11, and 17-20 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Osamu Nakamura et al., "Extraction Of Photographic Area From 



Application/Control Number: 10/767,061 Page 4 

Art Unit: 2624 

Document Images" (hereinafter "Nakamura"), further in view of Barski et al., US 
5,212,741 (hereinafter "Barski"). 

Regarding claims 10 and 20, which are representative of claims 1,7, 9, 11, 17, 
and 19, Nakamura discloses a method and device for binarizing an image (see page 80, 
section 3 where Nakamura discusses bi-level quantization of an image), comprising: an 
input part for receiving an image (figure 1 shows an input document image); a block 
classification part for dividing the received image into blocks (see page 77, section 
2.1(3) where Nakamura discusses segmenting the image into blocks), and classifying 
the divided blocks into character blocks and background blocks (see page 77-78, 
section 2.1(4) and 2.2 where Nakamura discusses classifying the blocks based on 
attributes); a block growing part for growing the classified blocks (page 79, section 
2.3(2): blocks are expanded), and restoring a misclassified block (figure 6 shows blocks 
reclassified during the expansion process); a block grouping part for grouping a 
character block output from the block growing part with its neighboring blocks, thereby 
generating a grouped block (see page 79, section 2.3(2) : merging blocks that become 
adjacent); a block splitting part for separating the character block from the grouped 
block (see page 79, section 2.3(3) where Nakamura discusses dividing integrated areas 
into sub-blocks); and a binarization part for binarizing pixels of character blocks into a 
first brightness value for character pixels and a second brightness value for background 
pixels by comparing the pixels of the character blocks with a threshold, and binarizing 
pixels of background blocks output from the block classification part into the second 
brightness value (see page 80, section 3, where Nakamura discusses the use of bi-level 
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and notchless bi-level quantization of an image to threshold the image into a binary 
equivalent image). 

While Nakamura discloses the block integration process for use on blocks 
classified as pictures elements, it would have been obvious to apply this same 
procedure to the text classified blocks, as the same results of grouping similarly 
classified blocks can be expected. Nakamura discloses the use of an edge 
enhancement operation (page 77, section 2.1(1): a Sobel operator is used to better 
define edges in the image) for use in classification, but does not use this on the image 
after classification. Also, the binarization process in Nakamura does not use a threshold 
established during the edge enhancement stage. Barski discloses an edge 
enhancement part for enhancing edges of a character block using relations between 
neighboring pixels in the character block, (column 6-7, lines 63-4: a mask which uses 
surrounding pixel values is used to enhance characters of a text area); and generating a 
threshold for distinguishing character pixels and background pixels of the character 
block which is used in a binarization process (column 7, lines 20-28: a histogram of the 
edge enhanced image is used to calculate a threshold used in binarization). 

It would have been obvious to one skilled in the art at the time the invention was 
made to modify the invention of Nakamura, and modify the binarization process to 
include an edge enhancement portion, as taught by Barski, thus bringing out higher 
frequency line details and improving optical character recognition of text, as discussed 
by Barski (column 6, lines 65-66 and column 2, lines 40-41}. 
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Regarding claims 8 and 18, Nakamura discloses the method and device of 
claims 7 and 17, wherein the block growing part comprises: a dilation part for growing a 
character block and changing a block containing a character pixel, classified as a 
background block, to a character block (see page 79, section 2.3(2} where Nakamura 
discusses expanding blocks by one width on each side}; and a closing part for eroding 
the dilated character block and deducting connected blocks (see page 79, section 2.2(5} 
where Nakamura discusses reclassifying blocks). Furthermore, the examiner takes 
official notice that the sequential process of dilation then erosion is known as closing 
and is known in the art to fill in small holes and gaps in pixel data. 

Claims 2, 3, 6, 12, 13, and 16 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nakamura in view of Barski as applied to claims 1 and 1 1 above, and 
further in view of Shan Mo et al., "Adaptive, Quadratic Preprocessing Of Document 
Images For Binarization" (hereinafter "Mo"). 

Regarding claims 6 and 16, are representative of claims 2 and 12, Barski 
discloses an edge enhancement part in which any suitable edge enhancement 
technique can be used (column 7, lines 7-9). Mo discloses an edge enhancement 
technique comprising: a first threshold selection part for calculating a first threshold for 
classifying each pixel of the character block as a character pixel or a background pixel 
(page 995, section IIA1, column 1: finding a global threshold level); a mean computation 
part for classifying pixels of the character block into character pixels and background 
pixels on the basis of the first threshold (page 995, section IIA1, columnl : determining 
whether a pixel is a background or character pixel using the threshold), and calculating 
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mean brightness values for character pixels and background pixels of the character 
block (page 995, section IIA1 , column 2: calculate average gray levels for character and 
background pixels separately); a normalization part for normalizing the pixels of the 
character block using the mean brightness value for character pixels and the mean 
brightness value for background pixels output from the mean computation part so that 
the character pixels have a value close to "1" while the background pixels have a value 
close to "0" (page 995, section IIA1 , column 2: normalize the data; column 1 : with 
values close to zero and one); a quadratic operation part for performing a quadratic 
operation on the normalized character block to enhance edges of the character block 
and reduce noise of the character block (page 995, section IIA3: apply the quadratic 
filter discussed on page 994 to the normalized data); a denormalization part for 
denormalizing the quadratic-processed character block and providing the denormalized 
character block to the binarization part (page 995, section IIA4: the output of the 
quadratic filter denormalizes by mapping output values close to desired values for 
background and character pixels); and a second threshold selection part for calculating 
a second threshold for classifying each pixel of the denormalized character block as a 
character pixel or a background pixel, and outputting the second threshold as a 
threshold for the binarization part (page 995, section IIA4: calculating a threshold for 
use in binarization). 

It would have been obvious to one skilled in the art at the time the invention was 
made to modify the invention of Nakamura and Barski, and modify the edge 
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enhancement means to use a quadratic preprocessing approach, as taught by Mo, thus 
improving the quality of binarized images, as discussed by Mo (see abstract). 

Regarding claims 3 and 13, Mo discloses using quadratic filters to edge enhance 
images (see abstract of Mo). 

5. Claims 4, 5, 14, and 15 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nakamura in view of Barski as applied to claims 1 and 1 1 above, and 
further in view of Ricardo L. de Queiroz et al., "Fast Segmentation Of The JPEG 
Compressed Documents" (hereinafter "de Queiroz"). 

Regarding claims 4 and 14, Nakamura discloses the method and device of 
claims 1 and 1 1 , wherein the block classification part comprises an image division part 
for dividing the received image into blocks having a predetermined size (see page 77, 
section 2.1 where Nakamura discusses segmenting the image into blocks of 32 x 32 
pixels). Nakamura also discloses thresholding and classification of an image based up 
on average energy in an image (see page 78, section 2.2 where Nakamura discusses 
using the mean level of the background as a threshold in determining block attributes). 
Nakamura does not explicitly disclose the use of discrete cosine transform conversion 
blocks and using the energy calculation of said blocks for region classification. 

de Queiroz discloses an image classification method including: a discrete cosine 
transform (DCT) conversion part for DCT-converting blocks output from the image 
division part (see page 368, section 2.1 where de Queiroz discusses JPEG 
compression involving the discrete cosine transform); an energy calculation part for 
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calculating a sum of absolute values of dominant DCT coefficients within each of the 
DCT-converted blocks, and outputting the calculated sum as an energy value of the 
corresponding block (see page 369, section 2.2 where de Queiroz discusses computing 
the energy of each DCT block using the absolute value of the DCT coefficients). 

It would have been obvious to one skilled in the art at the time the invention was 
made to modify the invention of Nakamura, and modify the energy detection means to 
include DCT coefficient block energy, as taught by de Queiroz, thus allowing faster 
segmentation and discrimination of areas in a compressed image, as discussed by de 
Queiroz (see page 367, section 1 .1). 

Regarding claims 5 and 15, de Queiroz discloses each of the blocks having a 
size of 8 x 8 pixels and a scalable summation for calculating the energy of each block 
(see pages 369-370, section 2.2 where de Queiroz discusses computing the AC energy 
of 64 pixel blocks). 

Conclusion 

6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Contact Information 
Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOHN B. STREGE whose telephone number is 
(571)272-7457. The examiner can normally be reached on Monday-Friday between the 
hours of 8-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella can be reached on (571) 272-7778. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Matthew C Bella/ 

Supervisory Patent Examiner, Art 

Unit 2624 
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